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WHEN THE SCALE IS UNKNOWN 1 
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Carleton University and University of British Columbia 

Most asymptotic results for robust estimates rely on regularity 
conditions that are difficult to verify in practice. Moreover, these re- 
sults apply to fixed distribution functions. In the robustness context 
the distribution of the data remains largely unspecified and hence re- 
sults that hold uniformly over a set of possible distribution functions 
are of theoretical and practical interest. Also, it is desirable to be 
able to determine the size of the set of distribution functions where 
the uniform properties hold. In this paper we study the problem of 
obtaining verifiable regularity conditions that suffice to yield uniform 
consistency and uniform asymptotic normality for location robust es- 
timates when the scale of the errors is unknown. We study M-location 
estimates calculated with an 5*-scale and we obtain uniform asymp- 
totic results over contamination neighborhoods. Moreover, we show 
how to calculate the maximum size of the contamination neighbor- 
hoods where these uniform results hold. There is a trade-off between 
the size of these neighborhoods and the breakdown point of the scale 
estimate. 

1. Introduction. Many robust location point estimates have been pro- 
posed in the last 35 years. Unfortunately, robust inference has not received 
the same amount of attention in the literature. Since the finite sample dis- 
tributions of robust estimates are unknown, robust inference typically relies 
on the asymptotic distributions of these estimates. 

According to the robustness model one does not know the actual dis- 
tribution of the data. Therefore it is highly desirable to have asymptotic 
results that hold uniformly over some set of plausible distributions. Hampel 
(1971) considered this problem and broke new ground showing that under 
certain regularity conditions M-location estimates have uniform asymptotic 
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properties on Prokhorov neighborhoods. These are the first results in the 
robustness literature that deal with uniform asymptotic properties of ro- 
bust estimates. Moreover, Hampel's results provide a valuable set of tools to 
evaluate and compare robust estimates based on their asymptotic behavior. 
Unfortunately his results only guarantee the existence of a neighborhood 
with unknown size where the uniform behavior holds. Determining the size 
of these neighborhoods seems to be a very difficult problem [see also Davies 
(1998)]. 

Huber [(1967); (1981), page 51] shows that when the scale of the er- 
rors is known, the M-location estimates are asymptotically normal and the 
approximation is uniform on the set of symmetric distributions that have 
all their mass concentrated on the points where the estimating equation is 
differentiable. Simultaneous estimation of location and scale with Huber's 
Proposal 2 was studied by Clarke (1980, 1986). In the first reference the 
author considers the problem of uniform convergence for these estimates 
and in the second proves that Huber's Proposal 2 estimates with nons- 
mooth estimating equations fall in the framework of Hampel (1971). More 
recently, Davies (1998) constructed M-location estimates with simultaneous 
scale estimates (Huber's Proposal 2) that are locally asymptotically nor- 
mal. Davies's results are "locally uniform"; that is, for each distribution 
function there exists a neighborhood of distributions where the convergence 
holds uniformly. Unfortunately, the size of these neighborhoods is unknown. 
Finally, Clarke (2000) shows that certain M-location estimates [including 
the simultaneous location and scale estimation proposed in Heathcote and 
Silvapulle (1981)] are continuous over full Prokhorov neighborhoods of the 
parametric model. It follows that these estimates have uniform asymptotic 
behavior over Prokhorov neighborhoods. Unfortunately, as in Hampel (1971) 
and Davies (1998), the size of these neighborhoods is unknown. 

Our results apply to location M-estimates calculated using an 5-scale 
[see Rousseeuw and Yohai (1984)]. These estimates are scale-equivariant 
[Rousseeuw and Leroy (1987), pages 158 and 159] and have simultaneous 
high breakdown point and high efficiency at the central model. Moreover, 
under verifiable regularity conditions we obtain uniform asymptotic results 
(consistency and asymptotic distribution) that hold over a contamination 
neighborhood of known size. The size of these sets depends on the breakdown 
point of the S-scale estimates (the higher the breakdown point, the smaller 
the set of distribution functions where uniformity holds; see Table 1, in 
Section 4). The regularity conditions we need in our results depend on two 
separate aspects of the inference procedure: the assumed "true" parametric 
model for the "good" data points, and the estimating equations used to 
calculate the robust estimate. 

The rest of the paper is organized as follows. Section 2 contains the defini- 
tions of the estimates we consider. Section 3 shows that under mild regularity 
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conditions these estimates are uniformly consistent on contamination neigh- 
borhoods. Section 4 gives additional assumptions under which the above 
estimates are uniformly asymptotically normal. Section 5 contains some con- 
cluding remarks and, finally, the Appendix contains sketches of the proofs 
of our main results. Details can be found in Salibian-Barrera and Zamar 
(2002). 

2. MM-location estimates. Consider the following location-scale model: 
let x\, . . . , x n be n observations on the real line satisfying 

(1) Xi = fi + aei, i = l,...,n, 

where e$, i = l,...,n, are independent and identically distributed (i.i.d.) 
observations with variance equal to 1. The interest is in estimating /i, and 
the scale a is considered a nuisance parameter. 

We will consider scale-equivariant M-location estimates £i n defined as the 
solution of an estimating equation of the form 

1 n 

(2) -^((xi-M/a n ) = 0, 

Tl . 1 

1=1 

where a n is an S-scale estimate of the residuals [Rousseeuw and Yohai 
(1984)] and -0:M^IR is a nondecreasing, odd and continuously differen- 
tiable real function. An example of such a function is given by 

if \u\ <0.8c, 
if 0.8c < \u\ < c, 
if \u\ > c, 

where c > is a user-chosen tuning constant, and Pa{u) = 38.4 — 17hu + 
300n 2 - 225-u 3 + 62.5u 4 [see Fraiman, Yohai and Zamar (2001) and also 
Bednarski and Zontek (1996), for other choices of smooth functions ip\. Fol- 
lowing Yohai (1987) we will call these M-location estimates obtained with 
an S'-scale MM-location estimates. 

The 5-scale estimate a n we use in (2) is defined as follows. Let p : K — > M + 
be a bounded, continuous and even function satisfying p(0) = 0. The S'-scale 
o n is defined by 

(4) a n = mfs n (t), 

where, for each tGl, s n (t) is the solution of 

1 n 

(5) -Y / p((xi-t)/s n (t)) = b, 



(3) 



\u/c\, 

ipc(u) =sign(u) <( p4(\u\/c), 
P4(l), 
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and b = E[p(u)]. Naturally associated with this family are the S-location 
estimates jl n given by 

(6) p, n = arginf s n (t). 

Beaton and Tukey (1974) proposed a family of functions pd given by 

' 3{u/d) 2 - 3,(u/d) A + {u/d) 6 , if |u| < d, 
1, if \u\ > d, 



(7) Pd (u) 



where the tuning constant d is positive. The above family of functions pd 
satisfies all the regularity conditions we need to obtain uniform asymptotic 
properties, and at the same time it yields scale estimates a n with good 
robustness properties. 

Remark 1 (ip ^ p'). Note that the estimating function ip in (2) need 
not be equal to p' in (5). Moreover, we will recommend using tp = ip c in (3) 
and p = pd in (7). 

Remark 2 (High efficiency and high breakdown point). The robust lo- 
cation estimates p n defined by (2) with o n as in (4) are scale-equivariant and 
can have simultaneously high breakdown and high efficiency at the central 
model. For example, the choice d = 1.548 for pd in (7), b = 0.5 in (5) and 
c = 1.525 for ip c in (3) yields a location estimate £i n with 50% breakdown 
point and 95% efficiency when the errors have a normal distribution. 

The asymptotic properties (consistency and asymptotic normality) of 
M-location estimates given by (2) are well known when the distribution of 
the errors is symmetric [Huber (1964, 1967, 1981), Boos and Serfling (1980) 
and Clarke (1983, 1984)]. The next two sections establish these properties 
uniformly over a set of distributions. 

3. Uniform consistency. The goal of this section is to determine verifiable 
conditions under which the scale-equivariant M-location estimates p n given 
by (2) are uniformly consistent on the contamination "neighborhood" 

(8) H £ (F ) = {F G V : F(x) = (1 - e)F ((x - p)/a) + sH(x)}, 

where T> denotes the set of all distribution functions, Fq is a fixed symmetric 
distribution, po and ctq are the unknown location and scale parameters, 
e G (0, 1 /2) and H is an arbitrary distribution function. Since in what follows 
the central distribution Fq is fixed, we write TC e to denote the set (8) above. 

Under certain regularity conditions (see references above) the M-location 
estimates fi n and the S-estimates a n and p n are consistent to the functionals 
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/z(.F), er(F) and fi(F) defined by the following equations. For each t G R, 
let cr(F,t) satisfy 

(9) E F [p((X-t)/a(F,t))]=b. 
The asymptotic value of a n is given by 

(10) a(F) = Ma(F,t). 

Similarly, for the S'-location estimate Ji n we have 

(11) A(i ? ) = arginfa(F,t). 

Finally for the M-location estimate fi n the corresponding equation is 

(12) E F mX-n(F))/*(F))}=0. 

Definition 1 (Uniform consistency). We say that the sequence of esti- 
mates f n is uniformly consistent to the functional t(F) over the contamina- 
tion neighborhood TC e if, for all 5 > 0, 



lim sup Pp 



sup |f n — t(F)\ > 5 



n>m 



0. 



where r (F) is the a.s. limit of r n for an i.i.d. sequence of observations with 
distribution function F. We will denote this type of convergence by f n —*T. 

Our main result in this section states that if the scale estimate a n in (2) 
satisfies a n A a and if ip is odd, nondecreasing, bounded and continuously 
differ entiable, then /i n A/i. 

Theorem 1 (Uniform consistency of the M-location estimate with gen- 
eral scale). Let x±, . . . ,x n be i.i.d. observations following the location model 
(1). Let tp satisfy the following: 

(P.l) \ip(u)\ < 1 for all ueR, and ip{-u) = -ij)(u) for u > 0; 
(P.2) tp is nondecreasing and limu-^oo ip(u) > 0; 
(P.3) V * s continuously differentiate. 

Suppose that a n in (2) has asymptotic breakdown point e* . Let < e < e* be 
such that ff n Air, Then if fi n satisfies (2), we have jx n —*ii. 



A sketch of the proof of Theorem 1 is given in the Appendix. A detailed 
proof can be found in Salibian-Barrera and Zamar (2002). 
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Remark 3 (Uniform consistency of 5-scale estimates). When a n is an 
5-scale estimate, Martin and Zamar (1993) showed that if Fq (the central 
distribution function in Tl E ) has an even and unimodal density, and if the 
function p is even, bounded, continuous and nondecreasing in [0, oo), then a n 
has asymptotic breakdown point 1/2. They also showed that if in addition 
Fq has a positive density on the real line, then for all < e < 1/2 we have 



Theorem 1 and Remark 3 imply that M-location estimates jX n given by (2) 
with ij) = ip c in the family (3) and scale a n given by (4) with p = pd in Tukey's 
family (7) have high breakdown point and high efficiency and are uniformly 
consistent over 7i £ for all < e < 1/2. 

4. Uniform asymptotic distribution. In this section we show that under 
certain regularity conditions the MM-location estimates fi n converge weakly 
to a normal distribution uniformly over the contamination neighborhood 7i e . 
These results are constructive and allow us to determine the size of the 
neighborhood 7i e where uniform asymptotic normality holds. The required 
regularity conditions will be mainly imposed on our estimating equations 
(2) and (4) and we will show that ijj = ip c in (3) and p = p<i in (7) satisfy these 
conditions. Hence, our results show that the scale-equivariant MM-location 
estimates have simultaneously high breakdown point, high efficiency at the 
central model and are uniformly asymptotically normal on a contamination 
neighborhood of known size (see Remark 2). 

Asymptotic results for asymmetric distributions are not easy to obtain. 
There are some results in the robustness literature dealing with this prob- 
lem [Carroll (1978, 1979), Carroll and Welsh (1988) and Rocke and Downs 
(1981)]. They show that when F is asymmetric the asymptotic distribution 
of the location estimate depends on that of the scale and that the asymp- 
totic variance calculated with the assumption of symmetry is not correct. 
Salibian-Barrera (2000) showed that in general the asymptotic distribution 
of location M-estimates for arbitrary distribution functions when the scale 
is estimated with an S*-scale depends on the behavior of the 5-scale and the 
corresponding 5-location estimate as well. Hence, to obtain uniform asymp- 
totics for these MM-location estimates we need uniform consistency of the 
S-scale and S-location estimates. 

5-scale estimates are uniformly consistent under relatively weak regularity 
conditions [see Martin and Zamar (1993) and our Remark 3]. 

Uniform consistency of S-location estimates requires more assumptions. 
For a given < e < 1/2 and an estimating function p in (5) let s + and s~ 
satisfy 



(13) 



s 



a. 



(14) 



< s < inf cr(F) < sup a(F) < s + < oo. 



UNIFORM ASYMPTOTICS FOR ROBUST LOCATION 



7 



Note that, from Lemma 1 in Martin and Zamar (1993), for all < e < 
min(6, 1 — 6) we have < infpg-^ cr(F) < sup^g-^ cr(F) < oo. To simplify 
the notation we will omit the dependence of s + and s~ on e. Assume that 
there exists t* G M. such that 



where s + and s~ are given in (14). 

Condition (16) can be slightly relaxed [see Salibian-Barrera and Zamar 
(2002), Lemma 7]. Assumptions (15) and (16) do not depend on the un- 
known distribution of the data F (only on Fq, the central distribution of the 
neighborhood 7i £ ) but are tedious to verify and will typically require numer- 
ical computations. Note that for a particular p these conditions impose an 
upper bound e = e(p, Fq) on the size of the contamination neighborhood TL £ . 
More specifically, fix the central distribution Fq and note that the left-hand 
side of (15) is a nondecreasing function of \t\. At the same time, the right- 
hand side is an increasing function of e. Hence, the smallest value t* = t*(e) 
that satisfies (15) is a nondecreasing function of e. Also, the left-hand side 
of (16) is a nonincreasing function of t* (and thus of e), while its right-hand 
side is increasing in e. It follows that there is a critical value e{p) such that 
both (15) and (16) hold for e < e(p), but fail to hold for e > e(p). When 
p = Pd belongs to Tukey's family (7) and the center of the contamination 
neighborhood is the standard normal distribution Fq = $ we used numeri- 
cal methods to find e{pd) for different choices of the tuning constant d (i.e., 
for different breakdown points). We found that there is a trade-off between 
the breakdown point of the scale estimate and the upper bound e{pd)'- the 
larger the breakdown point, the smaller the upper bound e{pd)- Table 1 lists 
the values of e(pd) for contamination neighborhoods of the standard normal 
distribution and estimating equations that yield estimates with breakdown 
points between 0.25 and 0.50. 

The following theorem states that under these conditions S*-location es- 
timates are uniformly consistent. This result will be necessary to obtain 
uniform asymptotic distribution of the M-location estimate calculated with 
an 5-scale as in (2). 

Theorem 2 (Uniform consistency of the S-location estimate). Suppose 
that the nonconstant function p satisfies the following assumptions: 

(R.l) p(-u) =p(u), u> 0, and sup ugR p(u) = 1; 



(15) 




V 1*1 >t* 



and 



(16) 
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(R.2) p(u) is nondecreasing in u> 0; 
(R.3) \p'(u)\ < K<oo, VtteR; 

(R.4) there exists < c < oo such that p(u) = 1 V \u\ > c. 

Let b £ (0, 1), jl n as in (6) and fi(F) as in (11). Let s + and s~ be as in (14) 
and suppose that < e is such that (15) and (16) hold. Then 

(17) lim sup Pj? sup \p n — fJ>(F)\ > 5 I = 0. 

m^oo FeHe V n>m / 

A sketch of the proof of Theorem 2 is given in the Appendix. A detailed 
proof can be found in Salibian-Barrera and Zamar (2002). 

We can now state our main result: when the M-location, 5-scale and S- 
location estimates are uniformly consistent, the M-location estimate has a 
uniformly asymptotically normal distribution. 

Theorem 3 (Uniform asymptotic distribution of MM-location estimates). 
Let fi n satisfy (2) with a function ip that satisfies assumptions (P.l) and (P.2) 
in Theorem 1 and the following: 

(P.4) ip is twice continuously differentiable; 

(P.5) there exists d > such that \ip(u) \ = 1 for all \u\ > d. 

Assume that the S-scale estimate a n in (2) is given by (4) with a function 
p that satisfies (R.1)-(R.4) in Theorem 2 and the following: 

(R.5) p is twice continuously differentiable. 

Suppose that e is such that (15) and (16) hold and that the center Fq of the 
contamination neighborhood 7i £ has a positive, even and unimodal density. 

Table 1 

Maximum size e(d) of contamination 
neighborhoods around the standard normal 
distribution where uniform consistency of the 

S-location estimate holds for different 
breakdown points (BP); the column labeled d 
contains the tuning constant that yields the 
respective BP 



BP 


d 


e(d) 


0.50 


1.548 


0.11 


0.45 


1.756 


0.14 


0.40 


1.988 


0.17 


0.35 


2.252 


0.20 


0.30 


2.561 


0.24 


0.25 


2.937 


0.25 
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Then 



where 



(18) 



P F { ^ n J' ) <x\-${x) 



lim sup sup 



V = V(p,a,F) 



0. 



H(F) 



and 



J(F) 



E F W({X - p(F))/a(F))(X - p(F))/a(F)} 
E F {p'((X - fi(F))/a(F))(X - fi(F))/<r(F)} 



A sketch of the proof of Theorem 3 is given in the Appendix. A detailed 
proof can be found in Salibian-Barrera and Zamar (2002). 

Remark 4 (Regularity conditions). The assumptions on Fq (the center 
of the contamination neighborhood) are needed to show that the S*-scale es- 
timate a n is uniformly consistent (a n A a). By Theorem 1 we also have that 
the MM-location estimates are uniformly consistent as well (jl n -^{i). The 
assumptions on the estimating equation p of the <S-scale a n and conditions 
(15) and (16) are needed to obtain uniform consistency of the S'-location 
estimate {jl n -^p). See Theorem 2. 



Using Table 1 we find, for example, that scale-equivariant MM-location 
estimates calculated with tp = ^1.525 in (3) and an 5-scale with p = /31.54s 
in (7) have simultaneously breakdown point 1/2, have 95% efficiency when 
the errors are normally distributed, and are uniformly asymptotically nor- 
mal on a contamination neighborhood of size at least e = 0.11. If, on the 
other hand, we use p = P2.937 m (7) we obtain estimates that have the same 
efficiency, that have lower breakdown point (25%) and that are uniformly 
asymptotically normal on a contamination neighborhood of size e = 0.25. 

5. Conclusions. There are four important properties of robust location 
estimates: translation and scale-equivariance [Rousseeuw and Leroy (1987), 
pages 158 and 159], high breakdown point, high efficiency and a reliable 
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algorithm to compute them. Moreover, it is desirable that their asymptotic 
theory satisfy two important features: be valid under verifiable regularity 
assumptions, and hold uniformly over a relatively large set of distribution 
functions with known size. 

With these desired properties in mind we propose to use scale-equivariant 
M-location estimates calculated with a smooth function tp in the fam- 
ily (3) and with an S-scale estimate calculated with a function p in Tukey's 
class (7). These MM-location estimates have simultaneously high break- 
down point and high efficiency at the central model. Moreover, we showed 
that under verifiable conditions they are uniformly consistent and uniformly 
asymptotically normal over a contamination neighborhood of known size. 
For each choice of breakdown point and efficiency we showed how to com- 
pute the size of the contamination neighborhood where these uniform results 
hold. When the center of these neighborhoods is the standard normal dis- 
tribution we found that these sizes range from 11% (for estimates with 50% 
breakdown point) to 25% (for 25% breakdown-point estimates). Hence, in 
most practical situations where the contamination is below 10% [Hampel, 
Ronchetti, Rousseeuw and Stahel (1986)], an MM-location estimate with 
50% breakdown point has uniform asymptotic properties that allow for re- 
liable statistical inference based on its asymptotic distribution. 

It is of much interest to obtain this kind of uniform asymptotic proper- 
ties for robust regression estimates. In principle, MM-regression estimates 
are good candidates to have satisfactory uniform asymptotic properties. 
Salibian-Barrera (2000) shows that under certain regularity conditions these 
estimates are asymptotically normal for any distribution in the contamina- 
tion neighborhood. The main technical difficulty when using the approach 
presented in this paper to study MM-regression estimates seems to be to find 
sufficient regularity conditions on the loss function p to show the uniform 
consistency of the (S-regression estimate. Once this is established, Theorems 
1 and 3 apply with appropriate modifications. 



A.l. Proofs. 

Proof of Theorem 1. For any t G K and F G H £ let p^(t,F) = 
EpipHX — t)/a(F)), and fix an arbitrary e > 0. Let a = cr(F), fi = /x(F), 
ip{x,t,s) = ip{{X-t)/s). Also let Y i (t)=ip(X i ,t,& n ) and Y(F, t) = EpTp(X, 
t,a). Let ip n (t) = ^T,i=i Y i( t ) and t-<"ip{t,F) = E F (iji(X,t,er)). For each m £ 
N, t £ R, F £ 7i £ and r > let 
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then linim^oo sup Fen= Fp(.A m (F,i, r)) = 0. We have 

{fi n < /x - e} C {|^ n (/x - e/2) - /^(/x - e/2, F)| > a(e)} = A n (F, e), 
where a(e) is given by a(i) = infp 6 -ft e /i^,(/x(F) — e/2,F). Similarly 

{fi n > /x + e} C {|VU/x - e/2) - ^(/x - e/2, F)| > 6(e)} = B n (F,e), 

where 6(e) equals 6(e) = mfpg^ — /i^,(/x(F) + e/2,F). It is easy to see that 

ct(e) = inf>ew e H^F) ~ ^/ 2 > F ) > °' and that & (^) = inf FeW s ~h(^( f ) + 
e/2, F) > 0. It follows that {\fi n - fi\ > e} C A n (F, e) U B n (F, e). Then 



■M m (F,e) = <^ sup |/t n - fj,\ >i 

C An(F /x - e/2, a(e)) U A m (F, /x + e/2, 6(e)). 
It follows that lim m ^oo sup^g-^ Fp[.M m (F, e)] =0. □ 

Proof of Theorem 2. We need to introduce the following notation. 
Let p(x,t,s) = p((x — t)/s). Denote the set of positive real numbers (0,oo) 
by R+. For each f £ 1 and s G let l(F,t,s) = E F p(X,t,s), and let 
Jn(t, s) = j(F n ,t, s) = - Ya=i p( x ii t, s )> where F n denotes the empirical dis- 
tribution function of the sample. It is easy to see that 

7 (F0,er(F))< 7 (F,t,<x(F)) V|i|>i*. 

Also, because of (16), there exists rj independent of F such that 

inf j"(F,t,s)>i]>0 VF£H £ , 

■t*,s~ <s<s+ 

where j"(F, t, s) = <9 2 7 (F, t, s)/dt 2 . Hence the family of functions 7 (F, t, cr(F)) 
with F 6 7i e has a unique minimum in the fixed interval (— t*,t*). For each 
F £ TC e denote this unique minimum by /x(F). Now fix an arbitrary neigh- 
borhood B 5 (fi(F)) of /2(F). Let e(<5,F) satisfy 

(19) inf 7 (F, t, <x(F)) > 7 (F, £(F), <r(F)) + e(5, F). 

We have that e = e(5) = infp g -ft e i(5, F) > 0. Choose an arbitrary 5 > and 
let I2CK and mo = nio(5) such that 

(20) Fp [fin 6 I2 Vti > m] > 1 - i V?n>?7i - 

We can now build a finite coverage (independent of F £ 7i £ ) of the set 
^2 H B$(fi(F)) c with balls B(t\), . . . , F(i r ) such that for every j = 1, . . . , r we 
have 



Fp 



inf p(AV',,t(F)) 



> 7 (F,A,o-(F)) + e. 
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For each of these centers t k let Yi(t k ) = mf t / £B ^ p(Xi,t' ,a n ) and 



Y(F,t k ) = E F 
Consider the events 



?E F \Yi(t k )]. 



inf p(X,t' ,cr(F)) 
L#eB(t k ) 



Am(F,t k ) = < sup \Y n (t k ) -Y{F,t k )\ <e\, meN. 

There exists m\{$) independent of F such that 

P F (A m (F,t k ))>l-5 Vm>mi(l), VFeW,, Vt fc E/ 2 . 
Now note that 

A m (F,t k )Q\ inf -^ /3 (x l ,t,«r ri )>7(F,/i(F),cr(F))+2e Vn>m 



C m (F,t k ). 



Let 



An(^) = - E ^ A(^), <r(F)) < l(F, (i{F),<t(F)) + e Vn > 



m 



i=i 



There exists m,2 = m,2(<5) (independent of F) such that for m > m,2 we have 

P F ( J D m (F))>l-5 VFeH e . 
Take 7713 = max(m,o, mi, 7712). We have 

P F [Cm{F)r\D m (F)}>\-2~5 Vm>m 3 , VFeH e . 
We also have 

C m (F) n D m (F) C [/i m G B 5 (fr(F)) Vm > m 2 ]. 

That is, for each A > we have limm-^ sup^ gW Pfr[sup n>m |/2 n — A(^)| 
> 5] = 0. □ 

Definition 2 (Uniform small o in probability). Let a n , n > 1, be a 
sequence of real numbers and let X n , n > 1, be a sequence of random vari- 
ables. We say that X n = Uop(a n ) over the set of distribution functions TC e 
if, V<5>0, 



lim sup Pp 

n->oo F€He 



x n 



>s 



0. 
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Definition 3 (Uniformly asymptotically normal). We say that a se- 
quence X n , n € N, is uniformly asymptotically normal (UAN) over the set 
of distribution functions Ti e if 

(21) sup sup\P F (X n <x)-$(x)\=o(l). 

FeHexm 

With the above definitions we can show that these "uniform little o," 
"uniform big O" and "uniform asymptotic distribution" behave similarly to 
their "nonuniform" counterparts. In particular, if a n = Uop(l) and X n is 
UAN, then X n + a n is UAN. 

Proof of Theorem 3. To simplify the notation, in what follows let 
fj, = p(F), fl = ji(F) and a = cr(F). The idea of the proof is to show that 
y/n(fi n — fi) can be represented as a linear term plus a uniformly small 
remainder. We use the Berry-Esseen theorem to show that the linear part is 
UAN (see Definition 3) and then argue that if a n = Uop{\) (see Definition 2) 
and X n is UAN, then X n + a n is UAN. First note that by Theorem 2 and 
Remark 4 we have a n — a = Uop(l), \x n — Ji = Uop(l) and p, n — fi = U op(l). 
The idea of the proof is to show that 

(22) -j= =Vn-^ + Uop(l), 
where 

= Wfa - (J.)/cr) - d{p{{xj - jj)/a) - ft)) 
e 

m) E F W({X-ri/a)(X-ri/a} 
1 j E F {p'{(X - p)/a)(X - fi)/a} ' 



e = E F \ip 



Note that \Wi\ are bounded and hence their moments are bounded uniformly 
for F £ Ti e - The variance of W% is bounded away from zero uniformly on 
F G 7i e ■ The Berry-Esseen theorem yields 



sup sup 



oil) 



Now, to complete the proof, use that if a n = Uop(l) and X n is UAN, then 
X n + a n is UAN. □ 
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